Maximum Entropy Principle with General Deviation Measures

نویسندگان

  • Bogdan Grechuk
  • Anton Molyboha
  • Michael Zabarankin
چکیده

An approach to the Shannon and Rényi entropy maximization problems with constraints on the mean and law invariant deviation measure for a random variable has been developed. The approach is based on the representation of law invariant deviation measures through corresponding convex compact sets of nonnegative concave functions. A solution to the problem has been shown to have an alpha-concave distribution (log-concave for Shannon entropy), for which in the case of comonotone deviation measures, an explicit formula has been obtained. As an illustration, the problem has been solved for several deviation measures, including mean absolute deviation (MAD), conditional value-at-risk (CVaR) deviation, and mixed CVaR-deviation. Also, it has been shown that the maximum entropy principle establishes a one-to-one correspondence between the class of alpha-concave distributions and the class of comonotone deviation measures. This fact has been used to solve the inverse problem of finding a corresponding comonotone deviation measure for a given alpha-concave distribution.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Invertible mappings and the large deviation theory for the $q$-maximum entropy principle

The possibility of reconciliation between canonical probability distributions obtained from the q-maximum entropy principle with predictions from the law of large numbers when empirical samples are held to the same constraints, is investigated into. Canonical probability distributions are constrained by both: (i) the additive duality of generalized statistics and (ii) normal averages expectatio...

متن کامل

Strengthened Large Deviations for Rational Maps and Full Shifts, with Unified Proof

For any hyperbolic rational map and any net of Borel probability measures on the space of Borel probability measures on the Julia set, we show that this net satisfies a strong form of the large deviation principle with a rate function given by the entropy map if and only if the large deviation and the pressure functionals coincide. To each such principles corresponds an expression for the entro...

متن کامل

Spatializing Random Measures: Doubly Indexed Processes and the Large Deviation Principle

Here θ is a probability measure on a Polish space , Dr k k = 1 2r is a dyadic partition of (hence the use of 2r summands) satisfying θ Dr k = 1/2r and Lq 1 Lq 2 Lq 2r is an independent, identically distributed sequence of random probability measures on a Polish space such that Lq k q ∈ N satisfies the large deviation principle with a convex rate function. A number of related asymptotic results ...

متن کامل

Strengthened large deviations for rational maps and Gibbs fields, with unified proof

For any hyperbolic rational map and any net of Borel probability measures on the space of Borel probability measures on the Julia set, we show that this net satisfies a strong form of the large deviation principle with a rate function given by the entropy map if and only if the large deviation and the pressure functionals coincide. To each such principles corresponds a new expression for the en...

متن کامل

Generalized-generalized entropies and limit distributions

Limit distributions are not limited to uncorrelated variables but can be constructively derived for a large class of correlated random variables, as was shown e.g. in the context of large deviation theory [1], and recently in a very general setting by Hilhorst and Schehr [2]. At the same time it has been conjectured, based on numerical evidence, that several limit distributions originating from...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Math. Oper. Res.

دوره 34  شماره 

صفحات  -

تاریخ انتشار 2009